DOCUMENT RESUME 



ED 220 020 HE 015 379 

AUTHOR Ruddock, Maryann Steele 

TITLE Assessing the Impact of Discontinuing a Program. AIR 

Forum 1982 Paper. 
PUB DATE May 82 

NOTE 19p.; Paper presented at the Annual Forum of the 

Associat ion for Institutional Research (22nd f Denver, 
CO, May 16-19, 1982) . 

EDRS PRICE MF01/PC0A Plus Postage. 

DESCRIPTORS College Faculty; *College Programs; Decision Making; 

Educational Finance; *Enrollment Trends; Higher 
Education ; *Majors (Students); *Needs Assessment; 
♦Program Costs; Program Evaluation; Resource 
Allocation; Student Needs; Teacher Salaries 

IDENTIFIERS *AIR Forum; *Program Discontinuance; Saint Edwards 

University TX 

ABSTRACT 

The impact of discontinuing an academic program at 
St. Edward* 6 University, Texas, was assessed by measurement on three 
levels: f irst-level effects on students and faculty; second-level 
effects on auxiliary offices and related courses and majors; and 
third-level effects on productivity and a profile of majors. Majors 
with a higher than average cost per student credit hour were studied. 
Brief summaries of three majors (unidentified) chosen for review are 
presented. One major had only one faculty member and nine student 
majors, and the program had a relatively high cost per student credit 
hour. The second program accounted for 2 percent of the undergraduate 
population; the third accounted for 5 percent of the undergraduate 
population. In making the decisions, the educational needs of 
students, including the potential student pool, and the problem of 
faculty tenure were considered important. For example, many nonmajors 
are staking courses in the program; the university may want to retain 
some faculty members to teach courses in this area although retaining 
no formal major. If only majors take courses in the program, all 
courses in the major may be eliminated and all faculty members let go 
or given alternate teaching assignment s . In addition, if the students 
in a certain program are all tprom out of state and that program is 
discontinued, recruitment may be channeled into other areas. The 
study methodology will enable the administration to identify the 
amount of money saved or reallocated by program discontinuance. 
Faculty salaries, room and board costs, and financial aid awarded are 
examples of resources that can be saved or reallocated. (SW) 



*********************************************************************** 

* Reproductions supplied by EDRS are the best that can be made * 

* from the original document. * 
*********************************************** 



ERIC 




o 
rvc 
o 

CD 

cvi 
r\j 



PHONE 512-444-2621 



ST. EDWARD'S UNIVERSITY 

AUSTIN, TEXAS 76704 



J 



ASSESSING THE IMPACT OF DISCONTINUING A PROGRAM 



u 



CHARTERED IN 1885 



Maryann Steele Ruddock 
Research Associ a te , P 1 ann i ng 
And I nst'ituti onal Research 



"PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 

'Association fn-r 



I ^ioLiLuL - t rrna^ Res ea rch 

TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC)." 



S t . Edwa rd 1 s Un i ve rs i ty 
300 1 S . Cong res s Ave . 
Austin, Texas 7870A 



U.S. DEPARTMENT DF EDUCATION 
NATIONAL INSTITUTE OF EDUCATION 

EDUCATIONAL RESOURCES INFORMATION" " 
CENTER I ERIC t- 
fhisi document ^ heen reproduced as 
received from the person or organisation 
originating it 

Minor r.htimjes hav town nude to improve 
reprodut tior> gu.ility 

Points ol view or opinions stated in this dor.u 
ment do not necessarily represent official NlE 
position (jr policy 



Paper presented at the Annual Forum of 

The Association for Institutional Research; 

Denver, Colorado; May 16 - 13, 19 82 - 



9 

ERLC 



1 

>0 



THE ASSOCIATION FOR INSTITUTIONAL RESEARCH 



This paper was presented at the Twenty-Second Annual 
Forum of the Association for Institutional Research 
held at the Denver Hilton Hotel in Denver, Colorado, 
May 16-19, 1982. This paper was reviewed by the 
AIR Forum Publications Committee and was judged to 
be of high quality and of interest to others concerned 
with the research of higher education. It has there- 
fore been selected to be included in the. ERIC Collection 
of Forum papers. 



D. R. Coleman, Chairman 
Forum Publication 
Advisory Committee 



3 



i 



ABSTRACT 



Academic program evaluation is the assessment of a program 
or major along two dimens ions--qual itati ve and quantitative. .In 
times of retrenchment and accountability, program eval uation may 
lead to program discontinuance, instead of program renewal. Most 
program evaluations study the program by itself and not in 
relation to the university as a whole. The question the univer- 
sity needs to ask is, "Would the f inanci al ' benef i ts gained from 
discontinuing a particular program cutwei gh the impact discon- 
tinuance would have on the various functions of the University as 
a whole?" The impact that discontinuance would have on a uni- 
versity is measured on three levels in the following manner: 
First Level Effects involve Student and Faculty data from that 
area; Second Level Effects are concerned with Auxiliary. Offices 
and Related Courses and Majors; and the Third Level Effects deal 
with Productivity and a Profile of Majors. Programs to be stu- 
died were Identified as those majors with a higher than average 
cost per stijdent credit hour. Data are provided for three 
majors. Comparisons across these programs on selected dara 
points illustrate implications of the data points. This data 
may be usedj under two different circumstances. The first would 
occur, wheg a university is trying to trim the budget by elimina- 
ting programs that represent a cost to the university but do not 
have .much i ! mpact on over-all university academic needs. The 
other type |of program discontinuance may occur when there is a 
period of flinancial exigency and large reductions in expenses 
heed to be 'made. 

this methodology was developed at a small, private institu- 
tion to address specific issues for that school; however, the 
model may be adapted by other institutions to suit their own 
needs. Thg methodology was conceived to complement qualitative 
data, not to take" its place. 
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ASSESSING THE IMPACT OF DISCONTINUING A PROGRAM 



In recent years much work has been done in the area of program evaluation - 
the assessment of the effectiveness, quality and efficiency of an academic 
program (B raskamp , . 1 980) . These three components have been emphasized differently 
in various studies. Starkman (1980) discusses the evaluation of the quality of 
academic programs and the different models- of assessment used. The effective- 
ness component is stressed in the evaluation by the Council on Program 
Evaluation (COPE) from the Un i ve fs i ty . of Illinois at Urbana-Ch'ampai gn .(Miller, 
1979). The State University of New York at Buffalo has combined all three 
components of program evaluation — quality, need and promise in their terms 
(Miller, 1979). 

These three components all revolve around the quality issue. Mingle (1978) 
in his study of selected state reviews of academic programs suggests that there 
are two types of reviews — quantitative and qualitative. The older type of 
evaluative review is the quantitative review — one which tends to eval u ate 
such things as the scope of the program (the number of students, the number of 
faculty, etc.), the productivity of the program (graduation and retention rates), 
and a statistical profile of the students enrolled in this program. This type 
of guantitative study continues to be needed. Even so, more recent approaches 
have stressed. the qualitative approach which includes the criteria of, duplica- 
tion, efficiency, need and effectiveness (Mingle, 1978). 

Theoretically, program evaluation has been conducted in order to improve 
a program (Starkman, 1980). In times of retrenchment and accountability, 
though, evaluation needs to be done with more practical and financial considera- 
tions in mind (Harcleroad, 1980). The Educatioh Commission of the States has 



recommended "that the function of program review and evaluation be expanded to 
include in its scope recommendations on reallocation, reorganization or even 
disconti nuance M (in Harcleroad, 1980) . 

Historically, there are two basic reasons for discontinuing a program. 
The first relates to academic viability and the second to cost. When a program 
is no longer academically viable there are often steps that can be taken before 
the final act of eliminating the program the faculty can be changed, changes 
in curriculum can be made, and the like. But, when operational costs of the 
program exceed what the institution is willing to pay, the school needs to 
seriously consider program discontinuance. The repercussions that may follow-'' 
discontinuance need to be looked at.. This is especially, true at small col leges o 
and universities where they are "...constantly struggling to maintain a positive 
image in order to attract students and persuade potential donors to invest in 
the institution's future 11 (Rugg, 1980). 

Most program evaluations study the program by itself and not in relation 
to the University as a whole. Specifically, no studies formally consider the 
Impact on the University if a particular major or program were discontinued. 
The question from the Un i ve rs i ty 1 s viewpoint is "Would the financial benefits 
gained from discontinuing a pa rt i cul a r ..program... outwei gh ;t he impact d i scon t i nuance 
would have on the various functions of the University as a whole?" While the 
concepts of cost-benefit analysis have recently been applied to education 
(Frost, 1971), this paper is concerned with quantifying the effects of program 
discontinuance on a University. The. subject of judging the size of those ef- 
fects will not be discussed. A methodology is provided for dete rmin i ng the 
impact of program discontinuance. 

When a program is discontinued, there are different levels of effect that 
are manifested. First level effects are those directly involving the students 



6 



- 3 - 

J 

who are majoring in that area and the faculty who are teaching in that area. 
Second level effects' are those involving different offices on campus (Financial 
Aid, Special Services, Housing, etc.) and courses taken in and out of this 
major. Third level effects are those that affect the school in a much broader 
manner; i.e., retention rates of majors in that area, a profile of the majors, 
etc. 

The question asked by this study is n What would be the total impact on 
St. Edward's University if this major offering were d i s cont i nued? n Data which 
assess first, second, and third level effects for several majors are presented. 
Throughout this paper the terms program and major are used interchangeably. 
While majors were studied at St. Edward's University, the concepts discussed > 
in this report may be applied to programs as well. 

. ' METHODOLOGY 

St. Edward's University uses cost per student credit hour as their measure 
of expense of a program. The majors with the highest cost per student credit 
hour were selected to be included in this study. Also included was a major 
for which the decision to discontinue had already been made. This paper 
presents the methodology used to look at each of these majors. 

v 

DESCRIPTION OF DATA POINTS 

Fi rst L^vel Effects 

The two types of data that are presented to show first level effects relate 

to students and faculty. 

/ 

Student Data. Data are presented showing the actual number of students 
who would be directly affected by discontinuing this major, and what year in 
the program these students are. ' Information on what percentage of the total 
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undergraduate enrollment this major accounts for is also given. To track 
students' satisfaction or dissatisfaction with a major, ,data are given for the 
number of students transferring to and from this major. 

Faculty Data . The number of faculty members who would be directly af- 
fected by discontinuing this major is presented along with information on 
f ul 1 -t i me/part-t i me status, rank, salary and whether or not the faculty member 
is tenured. Comparab le' data are presented for the University as a whole, in- 
cluding information on salary outlay 1 . 

Second Level Effects 

The major types of data that are presented are data for Auxiliary Offices, 
students outside of this major taking courses in this major and required courses 
for students in this area outside of the area. 

Auxi 1 i ary Of f i ces . These data encompass the various offices with which 
the students interact. Data on Financial Aid include total dollar amount of 
grants, scholarships, loans and work study for students in a particular major. 
Housing data reflect the number of males and females living in dorms, and the 
total dollar amount of room and board fees received. The number of times 

these students v i s i ted- --the- Heal th~ Cente r \ & t racked a long. with, the- number of 

-• ■ / 

tutoring and counseling sessions they attended. A 

Related Courses and -Majors , included \n tpi\s section is a breakdown of 
the number of students taking courses in J^h'is area. The number of majors, 
other students in the Division, and V^udents outside of the Division taking 
courses in this area is presented. This data shows the pool of students from 
which the major draws.- Also presented are other departmental areas in which 
courses in this major are required or recommended courses, that may affect the 
graduation requirements of all students. Courses required outside of this 
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major show what the impact of discontinuance may be on enrollment in other 
courses taught at the University. 

Th i rd Level Effects 

The types of data presented for third level effects are a profile of 
majors and productivity (graduation and retention rates). 

Prof i le of Majors . This section shows how the students in this major 
compare to other students in their Division and the student body as a whole 
on the basis of four variables: sex> average age, residence and full-time/ 
part-time status. These data have implications for recruitment and the 
University Mission Statement. 

Productivity . These data are comprised of the number of degrees granted 
in thjis major over the past five years plus the retention rates for students 
in this major and the University as a whole. Implications concern the effec- 
tiveness of this program. 

HOW DATA WILL BE USED 
Program discontinuance for financial reasons may occur under two different 
circumstances. The first would occur when a university is try Ing to trim the 
budget by eliminating programs that cost the university but do not have much 
impact on over-all university academic needs. The data points collected would 
allow an . admin i st rator to identify the majors that employ few faculty, have 
few majors enrolled in them and represent an expense to the Division. The 
other type of program discontinuance may occur when there is a period of finan- 
cial exigency and large reductions in expenses need to be made. Programs that 
cost more than they bring in, and would represent a large savings if eliminated, 
can be identified. The aim here is to maximize savings (monetary) while mini- 
mizing the number of students and faculty who would be affected. While these 
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objective data points may be gathered, it is ultimately a subjective judgment 
as to which programs should be eliminated. There are many intangibles that go 
into making a major what it is. It is the duty of the administrator to take 
into ( account the intangibles as well as ihe tangible facts when deciding 
whether or not to discontinue a program. 

; SELECTED PROGRAM REVIEWS 

The following is a summary of the three majors that have been chosen for 
review. Also included is a discussion of the implications for selected data 
points. 

Program A. This is the major for which the decision to j 
discontinue has already been made. This major had a relatively high cost per 
student credit hour and few students. There is only one faculty member teaching 
in this area and he # is not tenured. Since there are so few students (9) in this 
major, their impact, on the Auxiliary Offices is minimal. Eighty-three percent 
of the student credit hours taken in this major are taken by students outside 
of this major. One reason for this large of a percentage is that these courses 
help to fulfill the students' University Exploration Requirement. There is a 
larger percentage of male students in this major than in the Division or the 
University as a whole. These students are slightly younger than the general 
undergraduate population and are predominantly from foreign countries. Alb-of^ 
the students in Program A attend St. Edward's full-time. Thirteen degrees in 
this major have been awarded in the past four years with no growth potential 
shown. Because of the small number of entering freshmen (approximately three 
each year), no conclusions can be drawn concerning retention. 

Program B. The students in Program B account for two 
percent of the undergraduate population. While seven students transferred to 
this major from other majors, none transferred out of this area during the 
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Fall 1981 semester. There are two full-time faculty members teaching in 
this major, none of which are tenured. Students in Program B make up three 
percent of the undergraduate grant aqd scholarship recipients. They account 
for two percent of the students living in dorms and two percent of the students 
visiting the Health Center. A majority of the s t udents "taki ng courses in this 
major are from this major. Close to three-quarters of the students in Program 
B are female and they are an average of one year older than the average under- 
graduate. A majority of these students are from the Austin area. Three- 
quarters of the students in this major attend school full-time. Forty-three 
students have received degrees in this major in the last four years. Retention 
rates for entering freshmen in this major have fallen in recent years. 

Program C. The students enrolled in Program C account 
for five percent of the undergraduate population. Three s t udents t rans fe r red 
to this major from other majors while six students transferred out. There are 
eight faculty members teaching in this area, four are full-time and four are 
part-time. One faculty member from this area is tenured. Students in this 
major receive ten percent of the grants and scholarships awarded. They account 
for ten percent of the students living in dorms and eight percent of the students 
visiting the Health Center. Of all undergraduates receiving university sponsored 
tutoring or counseling, two percent are from Program C. Ninety-one percent of 
the student credit hours taken in this area are taken by students who are 
majors in this area. A majority of students in this major are female and 
these students average over three years younger than the undergraduate population 
Three-quarters of these .students are from out-of-state and 37% are enrolled 
full-time. Sixty-nine students have received degrees from Program C during 
the past five years. Although the number of first-time entering freshmen for 
this major has fallen in the past year, the overall retention rates have been 
above those for the University as a whole. 
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Discussion of Selected Data Points . Comparisons across programs illustrate 

, some of the implications of the data points. For the Second Level Effect - 

Related Courses and Majors (see Table I) » the three selected majors show 

marked differences in the distribution of students taking courses in this 

particular area. For Program A, a majority of the courses in this area are 

taken by students outside of,.the division in which the major is located. 

f 

Program A. is the major that has already been discontinued, but is was data 
such as this that led the Administration to retain an elective sequence, of 
courses in this area although not retaining a formal major An audience 
exists for courses in this area in addition to the majors from this area 
wanting or being required to take these courses.'- Program C, on the other hand, 
has 91% of its student credit hours being taken by majors from that area. If 
this major was discontinued and no courses offered in that area, it would 
affect few students outside of that major. 

Implications for recruitment can be illustrated by comparing across ( 
programs for the Third Level Effect - Profile of Majors (see Table ll). By 
looking specifically at the data for residence, a number of recruitment questions 
may be raised. Over fifty percent of the majors from Program A are International 
students. If the University foresees any charge in the number'of International 
students enrolled, this may affect enrollment in Program A. There is a large 
local audience for students in Program B. These students are older than the 
average undergraduate student and they come from the Austin area. They are 
tied to Austin by jobs and families {22% attend only part-time). Does the 
University want to continue providing a program for people with this limited 
mobility? What do these students add to the atmosphere of the University? 
In contrast to Program B, 76% of the students in Program C are from out-of- 
state and ugder the average undergraduate age. With reduced financial aid and 
a tightening economy wi 1 1 these -Students be willing to move to another state 
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to attend college? What do these young, full-time students add to the atmos- 
phere of the University? 

These data points may also help to identify those marginal programs whose 
impact on the University is slight, but would represent a savings to' the school 
if they were discontinued. Program A is an example of this type of major. 
There are only nine students enrolled as majors in this program and one non- 
tenured faculty member teaching in this area. In contrast, Program C would 
be an example of a program the Administration would look at if there was a 
period of financial exigency and drastic budget cuts were neeJed. This program 
has a high cost per student credit hour and would represent a large financial 
savings to the University (faculty salaries, etc.) if it were discontinued, 
but it also represents a great impact on the University (five percent of the 
undergraduate population, ten percent of the students living in dorms, etc.). 
The question to be answered by the Administration would be "Would the savings 
in faculty salaries, cost per student credit hour, etc. outweigh the loss of 
course offerings, room and board fees, etc. if Program C were to be discon- 
tinued? 11 This methodology is designed to help the Administration make these 
deci s ions . 

DISCUSSION 

In recent years academic program evaluation, in addition to being a way to 

improve the quality of a program, has been used as a means for determining 

whether or not a program should be retained. Eugene Craven (1980) writes: 

The much anticipated decade of the 1 980 1 s has arrived. The 
demand for accountability and the conditions of fiscal auster- 
ity are expected to'continue and, perhaps, to increase. The 
major new developments of the decade, however, are the pro- 
jected °demograph i c changes and thei r an t i ci pa ted rap id and 
substantial impact on enrollments and, hence funding of 
institutions. Academic program evaluation now assumes 
added importance: What programs are most central to an 

O 
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institution's mission? On what basis should decisions of 
resource reallocation or reduction among programs be made? 
What*fixed resources must be maintained to safeguard the 
quality of academic programs? How can programs be mounted 
in financially stringent times to meet the changing educa- 
tional needs of students, society, and scholarship? The 
very survival of certain academic programs and even some 
institutions may be at stake. 

To Craven's list of questions I would add "What would be the effect on the in- 
stitution if a specific major offering was discontinued?" Stated another way, 
an institution should ask "Given the assumption that since the program has a 
higher than average cost per student credit hour and eliminating this program 
would therefore save money, would this savings outweight the impact that dis- 
continuance would have on the various functions of the University as a whole?" 
A value judgment becomes involved. 

The major (First Level) effects concern the students and faculty in this 
area. There will be a certain number of freshmen, sophomores and juniors 
whose educational needs will have to be considered. For faculty, the primary 
concern is with tenured faculty members. By looking at the Second Level 
Effect of Related Courses and Majors, the potential student pool for courses 
in this major may be determined. If a lot of non-majors are taking courses 
in this area, the University may- want to retain some faculty members to teach 
courses in this area although retaining no formal major. If only majors take 
courses in this area, then all courses in the major may be eliminated and all 
faculty menders let go or given alternate teaching assignments. 

Although the function of the entire University is to serve its students, 
some offices more than others come into day to day contact with students. The 
amount of contact that students of various majors have with these offices will 
determine the effect that program discontinuance will have. It must be kept 
in mind that not all of the impacts will be negative. Financial Aid (except 
for BEOGs) comes to the University and the school assigns it to the individual 
students. If a major were eliminated and its majors no longer enrolled, the 



Financial Aid could go to other students. This is assuming, though, that if 
a major is discontinued all of its students would leave as opposed to trans- 
ferring to other majors. No data are available on which to draw conclusions 
about this occurrence. 

The Third Level Effect concerning Profile of Majors has implications 
for recruitment and fulfillment of the institution's Mission Statement. For 
example, the variable of residence may be related to recruitment. If the 
students in a certain program are aTl from out of state and that program is 
discontinued, recruitment may then be channeled into other areas. If part 
of the University's Mission Statement states that this institution wants to 
serve all age ranges of students, but a majority of the school's older than 
average students are in a certain major, the institution may choose not to 
discontinue that major. The Profile of Majors is a very fertile area for com- 
parisons and insights. 

The concept of financial benefits outweighing the impact on the various 

functions of the University is an important one. Rugg ( 1 980) talks about the 

hidden financial impacts: s 

...promises of future savings or cost avoidance must.be weighed 
against possible financial losses, which can include reductions 
in tuition revenues resulting from smaller student enrollment, 
reduced revenues in auxiliary enterprises such as dormitory 
housing and food services, reduced gift income, and special ex- 
penses such as severance payments^ for tenured faculty who are 
terminated or unempl oyment benefits to released personneJL^ 
Some of these financial losses result directly from the closing- 
of programs, while others may arise as a result of the discon- 
tinuance process itself and the negative public relations created. 

In addition to the repercussion of possible financial loss due to program 

discontinuance, a more basic question needs to be raised: "If the purpose of 

reviewing these programs is to save money, how much money will actually be 

saved if this program is discontinued?" Kubal '(1979) surveyed state agencies 

and of the 20 respondents who reported having discontinued programs, 35% did 



not know the amount of resources saved or reallocated, and only 35% of those 
respondents believed that resources had been saved. The methodology presented 
here will enable the admi n i s t rat ion , to a certain extent, to identify the amount 
saved or reallocated. Faculty salaries, room and board fees and Financial Aid 
awarded are examples of resources saved or reallocated. 

The methodology presented here was developed at a smal 1 , private insti- 
tution to address specific issues for that school. While this exact '"ftiethodol ogy 
may not be suitable for all programs or institutions, the model may be adapted 
by other institutions to suit thei r own needs. Even for St. Edward's University, 
the model was not as complete as hoped for. There are limitations on the types 
of data available. This model was originally visualized as presenting longitu- 
dinal data to show trends in the different programs, but that did not prove to 
be feasible because of unobta i nab 1 e data. The central issue of this study is a 
concept .that can be used at any institution: "What would be the impact on this 
institution' if this program was discontinued?" This methodology was conceived 
to complement qual i tat i ve data , not to take its place. 
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TABLE i 

SECOND LEVEL EFFECTS 
RELATED COURSES AND MAJORS 



P rog ram 
A 



Program 
B 



Program 
C 



Majors taking courses in 
this area 

Other students in Division 
taking courses in this area 

Students outside of Division 
taking courses in this area 



M% 
1 1% 
66% 



55% 



25% 



20/o 



3% 



1% 



Total number of students 

taking courses in this area 



hi 



1 1 5 



196 



4/82 



18 



T 

/ 



Sex 
Ma I e 
Fe ma 1 e 

Ave rage Age 

Re s i den ce 
Austin 



TABLE li 

TH I RD LEVEL EFFECTS 
P ROF I LE OF MAJORS 



Program Program Program 
A B C 



Out-of-state 



Status 



A 1 1 

Undergraduates 



78% 23% . 374 56% 

2 - n 71 6 3* 

22.5 24.9 19-7 24.0 

5 7% 7% 35% 



Texas, not Austin 22% 31% 17% 32% 

22% 11% 76/o 14% 



nternational 56% - . " '9* 



Full-time 100% 78* 97% 79% 



Part-time 



22 / 0 3% 2 1* 
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